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I. INTRODUCTION 

The problem of evolving networks [U- [J 0] 
longs to a new area of statistical physics with many 
interdisciplinary applications, from biology (sexual con- 
tacts, food webs, ecological networks) |(| via sociophysics 
(the strength of weak ties, terrorism, scientific collabora- 
tions, paper citations networks) p|, econophysics (agents' 
games and interactions, business contacts) |(J, to com- 
puter science (Internet infrastructure and world wide 
web) [13 • 

In all these cases a central role is played by graphs 
which allow to describe networks mathematically. A 
graph is a set V of N vertices and a set £ of L edges 
among vertices. A simple graph is a graph without loops 
(i.e. self-links) and without multiple edges. A forest is 
a graph without cycles (i.e. paths which start and end 
at the same node). Connected forest is called a tree p). 
The terminology depends on subject where graph theory 
is applied: vertices become nodes, actors and agents in 
computer science, socio- and econophysics, respectively. 
Edges are called links or interactions as well U3- LJ- LjJl - By 
evolving we mean adding subsequent nodes to an already 
existing graph with M links to M preexisting nodes. For 
M = 1 a tree, and for M = 2 a simple graph appears. 
Here evolution means growth. 

Other evolution strategy is to modify an existing net- 
work without its growth, i.e. without increasing number 
of elements of the set V. Formation of a network may 
take place via the rewiring procedure [l2T ] : starting with 
a ring of N connected nodes — each of them having K 
nearest neighbors — we destroy a randomly selected link 
i — m and create instead another link i — n. 

Another strategy is to start with N nodes and L 
edges between them. A structure formed in this way 
is termed Erdos-Renyi graph |l3j |. Similar approach 



•presented at the First Polish Symposium on Econo- and Socio- 
physics, Warsaw, Nov. 19-20, 2004 
^URL: http : //home . agh. edu.pl/malarz/ 
t Electronic address: kulakowski@novcll.ftj.agh.edu.pl 



was proposed by Gilbert |hj] where number N of nodes 
is fixed and a new link between each of N(N — l)/2 
pair is realized with given probability p. For N — > oo 
Gilbert and Erdos-Renyi models give the same results 
and p = 2LN~ 1 (N — Graphs described above are 

called classical random graphs (CRG) |l4j . The graph 
^thermalizatiofi^ is a generalization of the rewiring strat- 
egy accompanied by Metropolis dynamics [l5|. 

Let us denote P a (m) the probability that a new node 
will be attached to an existing node m. For the scale-free 
(preferential, Albert-Barabasi) networks jllj, P a (m) is 
proportional to the node degree k(m) (i.e. number of 
edges which leads from/to m) |2U3jj]. For the exponen- 
tial networks, P a (m) is uniform [2j,y|. 

In Fig. n examples of scale- free, exponential and CRG 
networks are presented. 

The aim of this work is a brief recapitulation of our re- 
cent numerical results, obtained with a simple algorithm 
of network growth, and a comparison of these results with 
some analytical predictions. The algorithm has been ap- 
plied to the exponential networks, the scale-free networks 
and the classical random graphs. The algorithm was ver- 
ified by a comparison of the results with exact iterative 
equations. In Sec. ILTIour algorithm is explained. In Sec. 
IHII we present the numerical results on the degree and de- 
gree distributions and their correlations, which appear to 
be relevant for some search algorithms. The distance dis- 
tributions are compared with theoretical formulas. Final 
conclusions (Sec. IIV|I close the text. 

II. MATRIX REPRESENTATION AND THE 
GROWTH 

A network containing N nodes is fully characterized by 
its adjacency matrix A, elements of which give number 
of edges between nodes i and j. In case of simple graphs 
— where multiple edges are forbidden — this matrix be- 
comes binary: aM{i,j) = 1 if the nodes i,j are linked 
together, and aN(i,j) = elsewhere. Absence of loops 
gives all diagonal elements equal to zero: 0^(1, i) = 0. 

In the distance matrix D, the matrix element d^ii,]) 
is the number of links along the shortest path from node 
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FIG. 1: Examples of networks for N = 200 and (a) scale-free: tree (M = 1) and (b) simple graph (M = 2), (c) exponential: 
tree (M = 1) and (d) simple graph (M = 2), (e) classical random graph: p = 0.02, (f) p — 0.05. (Figures using Pajek 



i to j. 

The conversion D — > A is trivial, as we need only 
change all elements larger than one to zero. For building 
the distance matrix D basing only on the adjacency ma- 
trix A is more complicated and several numerical tech- 



niques are available ^3 • These methods usually base on 
the list approach with the breadth-first search or depth- 
first search or subsequent usage the Dijkstra algorithm 
[l8| for all nodes. 

Here, we present algorithms for different kind of net- 
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works which allow for a construction of the distance ma- 
trices simultaneously with the network growth, and not 
afterward [H El ml E3 . 



A. Numerical approach 

For growing networks, the starting point is a matrix D 
for the tree of two nodes linked together: 



D, 



1 

1 



Selecting a node to to which a new node will be at- 
tached is equivalent to select a number to of column/row 
of the matrix D. Approaches presented here base on 
the fact that the distance d(n,i) = d(i,n) to a new 
node n from all other preexisting nodes i via node m 
is d(m, i) + 1 = d(i, to) + 1. 



1. Growing trees 

Let us start with the simplest case, i.e. when M = 1. 
In this case a tree appears. Subsequent stages of distance 
matrix D evolution D^r — > Djv+i for N > 2 are 



(la) 



(lb) 



V1<j<JV: d N+ i(N + l,i) = d N+1 (i, N + 1) = 

dN{m, i) + 1 

and for diagonal clement 

d N+1 (N +1,N +1) = 

since we do not allow for loops 0, |2jj. One step of 
the distance matrix D evolution for growing trees is pre- 
sented in Fig. 

2. Growing simple graphs 

In simple graphs cyclic paths are possible and the dis- 
tance matrix D is to be rebuilt when adding a new node 
[HI23. Suppose that a (N + l) th node is added to ex- 
isting nodes m and n 7^ to. Then, we have: 



V 1 < i,j < N : d N+ i(i,j) = min (d N (i,j), 



(2a) 



(2b) 



d N (i,m) + 2 + d N (n,j),d N (i,n) + 2 + d N (m,j)). 

For new, (N + 1) , column/row 

Vl<i<JV: d N+1 (N + l,i) = d N+1 (i, N + 1) = 
= min (djv(m, i), djsr(n, i)) + 1 

and again for the diagonal element 

d N+1 (N+l,N+l) = 0. (2c) 

Example of the distance matrix D evolution for a simple 
graph is presented in Fig. [3| 



3. Classical random graphs 

For CRG the starting point of simulations is an N x N 
matrix with all non-diagonal elements equal to N. Note 
that N is larger than any possible distance in connected 
graphs of N nodes. Now we go through all upper- 
diagonal elements of D and set d(i,j < i) equal to one 
with the probability p — basing on the CRG's definition. 
Obviously, the matrix D is kept symmetric. Each time, 
when a new edge is added, we have to rebuild the whole 
matrix D due to link between nodes i and j: 



VI < to, n < N : d(m 7 n) — min [dim, n), 
d{m, i) + 1 + d(j, n), d(m, j) + 1 + d(i, n)) . 



(3) 



After this procedure, the matrix D^v contains elements 
equal to N only if the graph is not connected [2lJ . 



4- The Kertesz list 

Additional vector r of nodes' labels may be useful. 
There, each node's label appears as an element of r as 
many times as it is degree of that node (see Fig. 0J. At 
each time when new (N + l) th node is added with M 
links to nodes labeled as mi, ■ • ■ , mMi these M labels 
are added to the list, as well as the new label {N + 1), 
which is added M times. By using a randomly chosen 
element of vector r as an label, to which new node will 
be attached, we realize the Albert-Barabasi rule 111 of 
preferential growth 23] . 



III. RESULTS OF THE SIMULATIONS 

When the evolution process is accomplished, the ma- 
trix D^v may provide much information on the graph. Let 
us denote [•■•], {■ • • } and (■ • ■ ) the averages over iV run 
different matrices, N nodes of network and iV 2 matrix 
elements, respectively. For example, the average num- 
ber of elements equal to d, denoted as Z4, in matrix D 
gives the average number of d th neighbors for each node 
(d = 1 — nearest neighbors, d = 2 — next-nearest neigh- 
bors, d — 3 — next-next-nearest neighbors, etc.). The i th 
node degree fcj = a N{i,j) is the number of "1" in 

i th row/column of D (and z\ — {k}). Average distance 
to node i from all other nodes 

N 

Zi^lN-^dNiiJ)}. 
3=1 

The network diameter I is the mean length of the shortest 
path between two vertices 

N 

l=[N- 1 J2ti} = ltfi}} = l(dN(iJ))}. 
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FIG. 2: One step of the distance matrix D4 — > D 5 evolution for growing trees. 
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FIG. 3: One step of the distance matrix D4 — > D5 evolution for growing simple graphs. 



FIG. 4: The Kertesz list for small graph presented above 
r = {1, 2, 2, 3, 3, 4, 4, 5, 3, 6, 3, 7}. The nodes with lower labels 
are older. When a new node is linked to preexisting graph 
by M edges, 2M labels are added to the initially existing set 
{1,2}. 



A. Distribution of node degrees 

Three kind of networks presented here derive their 
names from the distribution of node degrees: 

• for the scale-free networks we reproduce Pk(k) oc 
fc-T with 7 w 2.72 (M = 1) and 7 « 2.63 (M = 2), 
while the theoretical value is 3 and it is indepen- 
dent on M 0, EI • The numerical reduction of 7 is 
known to be caused by the finite-size effect. 

• for the exponential trees the node degree distribu- 
tion is verified to be -Pfc(fc) oc w~ where w = 2 
for M — 1 and w = 3/2 for M = 2. 

• the degree distribution for CRG follows the Pois- 
son distribution Pk(k) = exp(— {k}) ■ {k} k /k\, with 
{k} « 20 and {k} w 50 when N = 10 3 for p = 0.02 
and p = 0.05, respectively. Here, the average node 
degree may be evaluated as {k} = p(N — 1) [T^ | . 



B. Distribution of node-to-node distances 

Distribution of numbers d in distance matrix D gives 
node-to-node distance distribution (NNDD) Pd(d). As 
expected, NNDD for the simple graphs are more con- 
densed than NNDD for trees. Also, NNDD for the scale- 
free graphs (trees) are more condensed than NNDD for 
the exponential graphs (trees) [2(| [see Fig. HJa)]. As 
a rule, networks with more condensed NNDD are them- 
selves more compact. For large trees, NNDD may be 
approximated [2_4| as Pd(d) oc dexp(— Ad 2 ) — see Fig. 
13b). 

For exponential trees — where each node is chosen with 
the same probability as a potential candidate to which 
the next attachment will take place — it is possible to 
derive Efl ] exact iterative formula for the network 
diameter: 

{N + 1) 2 £(N + 1) = N(N + 2)£(N) + 2N (4a) 
and for all higher moments n > 2 of NNDD 



(N + l) 2 [(^ +1 (z, j))] = N(N + 2)[(d% (i, j))] + 

n— 1 



fe=l 



(4b) 



C. Search for a shortest path 

Shortest distance between nodes, averaged over the 
network is termed the network diameter. This diame- 
ter appears to be surprisingly short in the growing net- 
works: it increases with the number of nodes N as slowly 



5 



(a) scale-free networks, N=10 3 , N run =10 7 (M=1), N run =10 4 (M=2) 



(a) N=10 3 N run =10° (M=1), N mn =10 (M=2), N run =10^ (CRG) 
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(b) exponential networks, N=10 3 , N run =10 7 (M=1), N run =10 3 (M=2) 
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(c) classical random graphs, N=10 , N run =10 
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FIG. 5: Nodes' degree distribution Pk(k) for (a) scale-free, 
(b) exponential and (c) CRG. 
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(b) N=10 3 , N ryn =10 5 (M=1), N run =10 4 (M=2), N run =10 2 (CRG) 
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FIG. 6: Distribution of node-to-node distances. 



exponential trees, N mn =10 



1e+12 i 

n 
1 

1e+10 - 

3 
4 

1e+08 - 



1e+06 - ' 

8 

9 

10000 - 10 
100 - 



1 



1 




1000 



as log(A r ). This is known as the small world effect [T2| . 
For example, for over 800 million web pages in Internet 
(in 1999) you need, on average, only nineteen clicks to 
reach any of them starting with randomly selected home 
page of your browser . Table U shows the parameters 
a and /3 in the logarithmic law £(N) = a In N +0 for var- 
ious growing networks 19, 20, 22], obtained numerically. 

The small world effect has its sociological counterpart, 
discovered by Milgram in 60's. Several persons had 
to send letters to a dealer in Boston, unknown to them, 



FIG. 7: Dependence of n th moment [(d n (i,j))] for n = 
1, ■ • • ,10 on network size iV for the exponential tree. The 
lines are given by Eq. &4bl 



using their acquaintances. It was found that in the aver- 
age, a chain only six links was sufficient to get the target. 
The essential point in the strategy is the search for the 
next person. A choice — almost obvious — is to select a 
person most popular and famous (i.e. the node with the 
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TABLE I: The mean distance £(N) = a In N + (3 for different 
evolving scale-free and exponential networks. 
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(a) N=10 3 N run =10 7 (M=1), N run =10 3 (M=2), N rlln =100 (CRG) 
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(b) N=10 3 , N run =10 7 (M=1), N run =10 3 (M=2), N run =100 (CRG) 
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FIG. 8: Dependence of (a) to-node distance £(fc) and (b) 
MCNS efficiency n(k) for various kinds of networks. 



highest degree among your nearest neighbors). 

This strategy is termed as the most connected neighbor 
search (MCNS) 28]. The dependence of the average dis- 
tance £ from the node on given degree k to all other nodes 
for various networks is presented in Fig. [HJa) [21]. The 
slope of the curve £(&) brings an information, how this 
search strategy is effective for a given network. Thus, 
an effectiveness of MCNS for nodes of given k can be 
evaluated by an index 



V 



dhxk' 



(5) 



The dependence r](k) is presented in Fig. IHJb). 

The MCNS is more efficient for the exponential trees 
than for the scale-free trees, and much more efficient for 



trees (M = 1) than for simple graphs (M = 2). For the 
simple graphs, this search strategy is almost as inefficient 
as for CRG. In the scale-free networks, local fluctuations 
of degree are enhanced by subsequent linkings. Multiple 
centers of high degree can be created, and the growing 
concentrates on these centuries. Then, MCNS can be 
misleading, as it leads always to a local center; however, 
sometimes the target is somewhere else. This enhance- 
ment is absent in the exponential networks, and that is 
why MCNS works better there. We note that this argu- 
mentation works particularly well for trees |2l| . 



IV. SUMMARY 

We have described the algorithm of construction the 
distance matrix D of the exponential networks, the scale- 
free networks and the random networks. The core idea 
of the algorithm is that it works simultaneously with the 
network growth. The information coded in the distance 
matrix is equivalent to the information of the network 
structure. The algorithm's complexity is of order of A^ 2 
for trees, and of order of Af 3 for other networks. A next 
step could be to construct a method of comparison of dif- 
ferent networks by a comparison of their distance matri- 
ces, to check if the networks are topologically equivalent. 
However, the order of rows and columns of the distance 
matrix is set in accordance with the age of nodes, and 
this information is not preserved in the network topol- 
ogy. Then, to compare two distance matrices, one should 
shuffle all possible permutations of nodes. Such an algo- 
rithm is known to be non-polynomial |29j |. and therefore 
is not useful. 

Topological properties of the networks are analyzed by 
discussing their distance matrices. These matrices are 
found to be a convenient tool to investigate the degree 
distributions, the distance distributions, the small-world 
effect and some search algorithms in the networks. 

We believe that an understanding of topological prop- 
erties of complex network is the first step to understand- 
ing complex behavior occurring among actors and agents 
occupying the networks nodes |3(| ■ It may bring a useful 
information for modelers of social and economic systems. 



Acknowledgments 

We thank J. Czaplicki, A. Kardas and J. Karpihska 
for their valuable help and Z. Burda for fruitful discus- 
sions. KM. acknowledges support from Krakow Branch 
of the Polish Physical Society (PTF). Part of calcula- 
tions was carried out in ACK-CYFRONET-AGH. The 
machine time on SGI 2800 is financed by the Polish Min- 
istry of Science and Information Technology under Grant 
No. KBN/SGI2800/AGH/018/2003. 



7 



[1] J. Clark, D. A. Holton, A First Look at Graph Theory, 
(World Scientific, 1991); R. J. Wilson, Introduction to 
Graph Theory, (Addison- Wesley, 1996). 

[2] R. Albert, A.-L. Barabasi, Rev. Mod. Phys. 286 (2002) 
47. 

[3] S. N. Dorogovtsev, J. F. F. Mendes, Adv. Phys. 51 (2002) 
1079. 

[4] M. E. J. Newman, SIAM Rev. 45 (2003) 167. 

[5] S. N. Dorogovtsev, J. F. F. Mendes, A. N. Samukhin, 
Nucl. Phys. B653 (2003) 307. 

[6] F. Liljeros, C. R. Edling, L. A. N. Amaral, H. E. Stanley, 
Y. Aberg, Nature 411 (2001) 907; M. Lfissig, U. Bastolla, 
S. C. Manrubia, A. Valleriani, Phys. Rev. Lett. 86 (2001) 
4418; J. Camacho, R. Guimera, L. A. N. Amaral, Phys. 
Rev. E65 (2002) 030901 (R); J. Camacho, R. Guimera, 
L. A. N. Amaral, Phys. Rev. Lett. 88 (2002) 228102. 

[7] S. Render, Eur. Phys. J. B4 (1998) 131; A. Vazquez, 
cond-mat/0105031. 

[8] M. E. J. Newmann, Phys. Rev. E64 (2001) 016131; 
M. E. J. Newmann, Phys. Rev. E64 (2001) 016132; 
M. V. Simkin, V. P. Roychowdhury, Complex Syst. 
14 (2003) 269; M. V. Simkin, V. P. Roychowdhury, 
cond-mat/0305150; T. Erez, S. Moldovan, S. Solomon, 
cond-mat/0406695; S. Galam, A. Mauger, Physica 
A323 (2003) 695; S. Galam, Physica A336 (2004) 49; 
S. Galam, Eur. Phys. J. B26 (2002) 269; D. Stauffer, 
cond-mat/0204099; S. Galam, Eur. Phys. J. B26 (2002) 
269; A. Proykova, D. Stauffer, Physica A312 (2002) 
300; S. Solomon, G. Weisbuch, L. de Arcangelis, N. Jan, 
D. Stauffer, Physica A277 (2000) 239. 

[9] R. N. Mantegna, H. E. Stanley, Introduction to 
Econophysics (Cambridge University Press, 2000); 
A. Barranon, Inlin. AQ/0404009 M. Hohnisch, S. Pit- 
tnauer, D. Stauffer, cond-mat/0308358; D. Makowiec, 
P. Gnacinski, W. Miklaszeski, cond-mat/0307290; 
J. Goldenberg, B. Libai, S. Solomon, N. Jan, D. Stauffer, 
Physica A284 (2000) 335. 
[10] B. Shargel, H. Sayama, I. R. Epstein, Y. Bar- Yam, Phys. 
Rev. Lett. 90 (2003) 068701; D. Magoni, IEEE J. Se- 
lected Areas Commun. 21 (2003) 949; P. Crucitti, V. La- 
tora, M. Marchiori, A. Rapisarda, Physica A320 (2003) 
622; B. Shargel, H. Sayama, I. R. Epstein, Y. Bar- Yam, 
Phys. Rev. Lett. 90 (2003) 068701; A. E. Motter, T. 
Nishikawa, L. Ying-Cheng, Phys. Rev. E66 (2002) 65103; 
G.-J. Lin, X. Cheng, Q. Ou-Yang, Chinese Phys. Lett. 20 
(2003) 22; L. Zonghua, L. Ying-Cheng, Y. Nong, Phys. 
Rev. E66 (2002) 36112; L. Zonghua, L. Ying-Cheng, Y. 
Nong, P. Dasgupta, Phys. Lett. A303 (2002) 337; S. N. 
Dorogovtsev, J. F. F. Mendes, R. Cohen, K. Erez, D. ben- 
Avraham, S. Havlin, Phys. Rev. Lett. 87 (2001) 219801, 
219802; R. Cohen, K. Erez, D. Ben-Avraham, S. Havlin, 
Phys. Rev. Lett. 86 (2001) 3682; A.-L. Barabasi, R. Al- 
bert, H. Jeong, Physica A281 (2000) 69; K. M. King, 
Educom Bulletin 23 (1988) 5; W. H. Cunningham, J. 
Assoc. Comput. Machinery 32 (1985) 549. 
[11] R. Albert, A.-L. Barabasi, Science 286 (1999) 509. 



[12] D. J. Watts, S. H. Strogatz, Nature 393 (1998) 440. 
[13] P. Erdos, A. Renyi, Publications Mathematicae 6 (1959) 

290; P. Erdos, A. Renyi, Publ. Math. Inst. Hung. Acad. 

Sci. 5 (1960) 17. 
[14] S. N. Dorogovtsev, J. F. F. Mendes, cond-mat/0404593. 
[15] Z. Burda, J. D. Correia, A. Krzywicki, Phys. Rev. E64 

(2001) 046118. 

[16] W. de Nooy, A. Mrvar, V. Batagelj, Exploratory 
Social Network Analysis with Pajek, (Cambridge 
UP, 2005); P. Doreian, V. Batagelj, A. Ferligoj, 
Generalized Blockmodeling, (Cambridge UP, 2005); 
http : //vlado . fmf .uni-lj . si/pub/networks/pa jek/ 

[17] H. P. Schultz, J. Chem. Inf. Comput. Sci. 40 (2000) 1158; 
W. R. Miiller, K. Szymanski, J. V. Knop and N. Trina- 
jstic, J. Compt. Chem. 8 (1987) 170. 

[18] T. H. Cormen, C. E. Leiserson, R. L. Rivest, Introduction 
to Algorithms, (The MIT Press, 2001). 

[19] K. Malarz, J. Czaplicki, B. Kawecka-Magiera, 
K. Kulakowski, Int. J. Mod. Phys. C14 (2003) 1201. 

[20] K. Malarz, J. Karpihska, A. Kardas, K. Kulakowski, 
TASK Quarterly 8 (2004) 115. 

[21] K. Malarz, K. Kulakowski, Eur. Phys. J. B41 (2004) 333. 

[22] K. Malarz, K. Kulakowski, Physica A345 (2005) 326. 

[23] D. Stauffer — priv. commun. 

[24] Z. Burda, J. Erdmann, B. Petersson, M. Wattenberg, 

Phys. Rev. E67 (2003) 026105. 
[25] A.-L. Barabasi, Phys. World, July 2001. 
[26] S. Milgram, Psychol. Today 2 (1967) 60; J. Travers, 

S. Milgram, Sociometry 32 (1969) 425; 
[27] http: / /smallworld. Columbia, edu/. 
[28] B. J. Kim, C. N. Yoo. S. K. Han, H. Jeong, Phys. 

Rev. E65 (2002) 027103; L. A. Adamic, R. M. Lukose, 

A. R. Puniyani, B. A. Huberman, Phys. Rev. E64 (2001) 

046135. 

[29] M. R. Garey, D. S. Johnson, Computers and Intractabil- 
ity. A Guide to the Theory of NP-Completeness. (Free- 
man, New York, 1979). 

[30] K. Malarz, J. Karpihska, K. Kulakowski, B. Tadic, - 
in preparation; B. Tadic, K. Malarz, K. Kulakowski, 
cond-mat/0411223; D. Stauffer, K. Kulakowski, TASK 
Quarterly 7 (2003) 257; J. Bonnekoh, Int. J. Mod. Phys. 
C14 (2003) 1231; K. Malarz, Int. J. Mod. Phys. C14 
(2003) 561; A. S. Elgazzar, Physica A324 (2003) 402; 
P. R. A. Campos, V. M. de Oliveira, F. G. B. Mor- 
eira, Phys. Rev. E67 (2003) 26104; S. N. Dorogovtsev, 
A. V. Goltsev, J. F. F. Mendes, Phys. Rev. E66 (2002) 
016104; A. Aleksiejuk, J. A. Holyst, D. Stauffer, Physica 
A310 (2002) 260; M. Kuperman, D. Zanette, Eur. Phys. 
J. B26 (2002) 387; H. Hong, B. J. Kim, M. Y. Choi, 
Phys. Rev. E66 (2002) 018101; P. Svenson, D. A. John- 
ston, Phys. Rev. E65 (2002) 036105; C. P. Herrero, Phys. 
Rev. E65 (2002) 066110; A. S. Elgazzar, Int. J. Mod. 
Phys. C12 (2001) 1537; A. Pekalski, Phys. Rev. E64 
(2001) 057104. 



